Performance Assessment Through Bootstrap
نویسندگان
چکیده
A new performance evaluation paradigm for computer vision systems is proposed. In real situation, the complexity of the input data and/or of the computational procedure can make traditional error propagation methods infeasible. The new approach exploits a resampling technique recently introduced in statistics, the bootstrap. Distributions for the output variables are obtained by perturbing the nuisance properties of the input, i.e., properties with no relevance for the output under ideal conditions. From these bootstrap distributions, the confidence in the adequacy of the assumptions embedded into the computational procedure for the given input is derived. As an example, the new paradigm is applied to the task of edge detection. The performance of several edge detection methods is compared both for synthetic data and real images. The confidence in the output can be used to obtain an edgemap independent of the gradient magnitude.
منابع مشابه
A New Robust Bootstrap Algorithm for the Assessment of Common Set of Weights in Performance Analysis
The performance of the units is defined as the ratio of the weighted sum of outputs to the weighted sum of inputs. These weights can be determined by data envelopment analysis (DEA) models. The inputs and outputs of the related (Decision Making Unit) DMU are assessed by a set of the weights obtained via DEA for each DMU. In addition, the weights are not generally common, but rather, they are ve...
متن کاملA New Bootstrap Based Algorithm for Hotelling’s T2 Multivariate Control Chart
Normality is a common assumption for many quality control charts. One should expect misleading results once this assumption is violated. In order to avoid this pitfall, we need to evaluate this assumption prior to the use of control charts which require normality assumption. However, in certain cases either this assumption is overlooked or it is hard to check. Robust control charts and bootstra...
متن کاملBootstrap resampling as a tool for radio - interferometric imaging fidelity assessment
We report on a numerical evaluation of the statistical bootstrap as a technique for radio-interferometric imaging fidelity assessment. The development of a fidelity assessment technique is an important scientific prerequisite for automated pipeline reduction of data from modern radio interferometers. We evaluate the statistical performance of two bootstrap methods, the model-based bootstrap and...
متن کاملBootstrapping Errors-in-Variables Models
The bootstrap is a numerical technique, with solid theoretical foundations, to obtain statistical measures about the quality of an estimate by using only the available data. Performance assessment through bootstrap provides the same or better accuracy than the traditional error propagation approach, most often without requiring complex analytical derivations. In many computer vision tasks a reg...
متن کاملUs Ska Tdp
We report on a broader evaluation of statistical bootstrap resampling methods as a tool for pixel-level calibration and imaging fidelity assessment in radio interferometry. Pixel-level imaging fidelity assessment is a challenging problem, important for the value it holds in robust scientific interpretation of interferometric images, enhancement of automated pipeline reduction systems needed to ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- IEEE Trans. Pattern Anal. Mach. Intell.
دوره 19 شماره
صفحات -
تاریخ انتشار 1997